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BACKGROUND OF THE INVENTION 



1. 



Field of the Invention 



25 



The invention relates to the field of embedded 



processor architecture and more particularly to 



multithreaded central processing units (CPUs) . 



2 . 



Description of Background Art 
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Conventional embedded processors , e.g., 
microcontrollers, support only a single hard real-time 
asynchronous process since they can only respond to a single 
5 interrupt at a time. Most software implementations of 

hardware functions— called virtual peripherals (VPs) —respond 
asynchronously and thus their interrupts are asynchronous. 
Some examples of VPs include an Ethernet peripheral (e.g., 
100 Mbit and 10 Mbit Transmit and receive rates); High-speed 

10 serial standards peripherals, e.g., 12 Mbps universal serial 
bus (USB) , IEEE-1394 Firewire Voice Processing and 
Compression: ADPCM, G.729, Acoustical Echo Cancellation 
(AEC) ; an image processing peripheral; a modem; a wireless 
peripheral, e.g., an IRDA (1.5 and 4 Mbps), and Bluetooth 

15 compatible system. These VPs can be used as part of a home 
programmable network access (PNA) system, a voice over 
internet protocol (VoIP) system, and various digital 
subscriber line systems, e.g., asymmetric digital subscriber 
line (ADSL) , as well as traditional embedded system 

20 applications such as machine control. 

An embedded processor is a processor that is used for 

specific functions. Embedded processors generally have some 

memory and peripheral functions integrated on-chip. 

25 Conventional embedded processors have not been capable of 

operating using multiple hardware threads. 
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A pipelined processor is a processor that begins 
executing a second instruction before the first instruction 
has completed execution. That is, several instructions are 
5 in a ""pipeline 1 ' simultaneously, each at a different stage. 
Figure 1 is an illustration of a conventional pipeline. 



The fetch stage (F) fetches instructions from memory, 
usually one instruction is fetched per cycle. The decode 

10 stage (D) reveals the instruction function to be performed 
and identifies the resources needed. Resources include 
general-purpose registers, buses, and functional units. The 
issue stage (I) reserves resources. For example, pipeline 
control interlocks are maintained at this stage. The 

15 operands are also read from registers during the issue 

stage. The instructions are executed in one of potentially 
several execute stages (E) . The last writeback stage (W) is 
used to write results into registers. 

20 One example of a non-conventional multithreaded 

processor is described in U.S. Patent application 09/748,098 
that is referenced above, that enables each stage of the 
pipeline to be processing a thread that is different from 
the thread in either the preceding or following stage. This 

25 permits the multithreaded processor to interleave the 

-3- 

F&W Ref . 6029 
20880/06029/DOCS/l 176973.3 



processing of multiple threads which permits the timely 
processing of time-critical applications and interrupts, for 
example . 



5 A problem with conventional multithreaded processors is 

that each thread has a separate hardware state for each 
thread. This hardware state may be in the form of separate 
sets of registers. However, in normal operation such 
conventional systems permit each thread access only to its 

10 own set of state registers, i.e., its own state. There is 
no ability to use or alter the characteristics of other 
states. This restriction limits the ability for a 
particular thread to take control of the system and to 
initialize a thread while other threads are still operating, 

15 for example. 



What is needed is a system and method that (1) enables 
a thread in a multithreaded processing environment to access 
states of other threads and; (2) enables a thread to store 
20 states of other threads. 



SUMMARY OF THE INVENTION 

25 The invention is a system and method for the enabling 

multithreaded processing in an embedded processor such that 
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one thread may access and store information into the state 
of a different thread. The present invention uses a 
register to identify the state from with a source operand is 
retrieved and to identify the state to which a destination 
5 operand is stored. In addition, the present invention 
includes an instruction that permits the setting of the 
source and destination thread back to the executing thread. 



BRIEF DESCRIPTION OF THE DRAWINGS 

10 

Figure 1 is an illustration of a conventional pipeline 
in a pipelined processing environment. 



Figure 2 is an illustration of an interrupt response in 
15 a conventional multithreaded environment. 



Figure 3 is an illustration of a multithreaded fetch 
switching pipeline according to one embodiment of the 
present invention. 

20 

Figure 4 is an illustration of an embedded processor 
according to one embodiment of the present invention. 

Figure 5a is an illustration of the thread selection 
25 process and context selection process according to one 
embodiment of the present invention. 
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Figure 5b is a flowchart of the context access 
selection and context write selection process according to 
one embodiment of the present invention. 

Figure 6A is an illustration of several sets of 
registers, each set of registers storing the state of one 
context, e.g., thread, according to one embodiment of the 
present invention . 

Figure 6B is an illustration of a control and status 
register (CSR) according to one embodiment of the present 
invention. 

Figure 7a is an illustration of a strict scheduling 
example according to one embodiment of the present 
invention . 

Figure 7b is an illustration of a semi-flexible 
scheduling example according to one embodiment of the 
present invention . 

Figure 7c is an illustration of a loose scheduling 
example according to one embodiment of the present 
invention. 
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Figure 7d is an illustration of a semi-flexible thread 
schedule using three hard-real time threads according to one 
embodiment of the present invention. 

5 Figure 8 is an illustration of thread fetching logic 

with two levels of scheduling according to one embodiment of 
the present invention. 

Figure 9 is an illustration of the HRT thread selector 
10 according to one embodiment of the present invention. 

Figure 10 is an illustration of the NRT shadow SRAM 
thread selector and SRAM accessing logic according to one 
embodiment of the present invention. 

15 

Figure 11 is an illustration of the NRT thread 
availability selector according to one embodiment of the 
present invention. 

20 Figure 12 is an illustration of the NRT flash memory 

thread selector according to one embodiment of the present 
invention. 

Figure 13 is an illustration of the post fetch selector 
25 according to one embodiment of the present invention. 
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Figure 14 is an illustration of a multithreaded issue 
switching pipeline according to one embodiment of the 
present invention . 

5 

Figure 15 is an illustration of a multithreaded, 
pipelined fetch parallel decode pipeline according to one 
embodiment of the present invention. 

10 Figure 16 is an illustration of a multithreaded 

superscalar pipeline according to one embodiment of the 
present invention . 



15 DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

A preferred embodiment of the present invention is now 
described with reference to the figures where like reference 
numbers indicate identical or functionally similar elements. 
20 Also in the figures, the left most digit (s) of each 

reference number corresponds to the figure in which the 
reference number is first used. 

The present invention is a system and method that 
25 solves the above identified problems. Specifically, the 
present invention enables multithreading in an embedded 
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processor such that one thread can read state information 
from another thread and can write state information to the 
state of another thread. 



5 The multithreading capability of the present invention 

permits multiple threads to exist in the pipeline 
concurrently. For example, a multithread environment can be 
used to efficiently handle interrupts where is interrupt 
service routine can be a separate thread. Figure 2 is an 

10 illustration of an interrupt response in a multithreaded 

environment. Threads A and B are both hard-real-time (HRT) 
threads which have stalled pending interrupts A and B 
respectively. Thread C is the main code thread and is non- 
real-time (NRT) . When interrupt A occurs , thread A is 

15 resumed and will interleave with thread C. Thread C no 
longer has the full pipeline throughput since it is NRT. 
When interrupt B occurs thread B is resumed, and, being of 
the same priority as thread A, will interleave down the 
pipeline, thread C is now completely stalled. The main code, 

20 thread C, will continue executing only when the HRT threads 
are no longer using all of the pipeline throughput. Each 
thread has an associated set of registers that stores the 
state of that thread and is used when processing the thread. 
The present invention enables one thread, e.g., thread C, to 
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access and modify the state of another thread, e.g., state 
A, as described below. 

Figure 4 is an illustration of an embedded processor 
5 according to one embodiment of the present invention. The 
embedded processor can include peripheral blocks, such as a 
phase locked loop (PLL) , or a watchdog timer. The embedded 
processor can also include a flash memory with a shadow 
SRAM. The shadow SRAM provides faster access to the program. 

10 In some semiconductor manufacturing processes SRAM access is 
faster than flash access. The loading of a program into the 
shadow SRAM is under program control. The embedded processor 
also includes a conventional SRAM data memory, a CPU core, 
input/output (10) support logic called virtual peripheral 

15 support logic, and a math coprocessor. The multithreading 
aspect of the present invention takes place largely in the 
CPU where the multiple thread contexts and thread selection 
logic reside. In addition, in some embodiments the 
multithreading might also exist in a coprocessor or DSP core 

20 which is on the same chip. 

Figure 3 is an illustration of a multithreaded fetch 
switching pipeline according to one embodiment of the 
present invention. The processor will function with 
25 information from different threads at different stages 

within the pipeline as long as all register accesses relate 
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to the correct registers within the context of the correct 
thread. 

By thread switching every cycle (or every quanta, i.e., 
5 a set number of cycles or instructions) the system will also 
reduce/eliminate the penalty due to a jump (requiring a 
pipeline flush) depending on the number of equal-priority 
threads which are active. There is only a need to flush the 
jumping thread and so if other threads are already in the 
10 pipeline the flush is avoided/reduced. 

As described above, a program context is the collection 
of registers that describe the state of the machine. Each 
thread has its own context. A context would typically 
15 include the program counter, a status register, and a number 
of data and address registers. It is possible that there are 
also some other registers that are shared among all 
programs . 

20 As an instruction is passed down the pipeline, a 

context number is also passed with it. This context number 
determines which context registers are used to load the 
program counter, load register values from or to save 
register values to. Thus, each pipeline stage is capable of 

25 operating in separate contexts. Switching between contexts 
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is simply a matter of using a different context number. In 
other embodiments of the present invention the decode and 
issue stages are combined into a single stage. 



5 Figure 5a is an illustration of the thread selection 

process and context selection process according to one 
embodiment of the present invention. Figure 5b is a 
flowchart of the context access selection and context write 
selection process according to one embodiment of the present 

10 invention. The process of identifying the context of a 

thread is described with respect to Figures 5a and 5b. A 
thread is selected 502 in the thread selection unit 510 
using any one of a variety of processes. Some techniques 
for scheduling and selecting threads are described below. 

15 Each thread has an associated context (state) . Therefore, 
once the thread is selected, the context is known. In one 
embodiment of the present invention, a read only status 
register that is associated with a particular thread (and is 
described below with reference to Figure 6) stores the 

20 context number. The next instruction in the thread is then 
fetched 504 in and the instruction address is decoded and 
stored in the program counter 512. The instruction is then 
fetched from memory 514. In one embodiment of the present 
invention instructions may use operands that are fetched and 

25 stored in source registers, e.g., two source registers (SI, 

S2) and the result of the instruction is stored in a 

destination register (D) . In other systems when executing 
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the instruction the source registers and the destination 
registers must all be from the same context. In the present 
invention, one or more of these registers can be from a 
different a set of registers associated with a different 
5 context. The details of how this is accomplished, according 
to one embodiment of the present invention, is described 
below. 



The present invention determines 506, for each register 

10 of each operand which context should be used as the source 
or destination. For example, to add the contents of two 
registers (A, B) and store them in a third register (C) the 
ADD operand of one embodiment of the present invention 
determines the context, i.e., the set of context registers 

15 516, from which register A and B are to be retrieved. In 
one embodiment of the present invention, the second source 
register, e.g., B, is always retrieved from the context of 
the instruction. If the instruction is part of a thread 
associated with a first context the present invention can 

20 use register from a second context. To do this, the address 
of register A is the address of a register in the set of 
registers representing the second context. Similarly, when 
storing the result in register C, the present invention 
determines the context, and thus which set of registers, the 

25 result should be stored in. 
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Figure 6a is an illustration of several sets of 
registers, each set of registers storing the state of one 
context, e.g., thread, according to one embodiment of the 
present invention. Each set of registers forms a context in 
5 which a program thread executes. Figure 6a includes 7 
contexts with each context having 32 general purpose 
registers, 8 address registers and a variety of other 
information as illustrated. The type of data that is stored 
as part of a thread's context may differ from that 
10 illustrated in Figure 6a. 

In the embodiment of the present invention illustrated 
in Figure 6a registers D0-D31 are general purpose 32 bit 
data registers. Registers A0-A6 are 32 bit address 

15 registers and are used as pointers to operands, as described 
above. Register A7 is a 32 bit stack pointer register. 
MAC_HI is a 32 bit register that stores the high 16 bits of 
a multiply-accumulate (MAC) result. MAC_LO is a 32 bit 
register that stores the lower 32 bits of the multiply and 

20 accumulate result. The MAC_RC16 register is a rounded and 

clipped S16.15 image of the MAC register contents and can be 
used for a variety of functions including creating a result 
for a digital signal processing application, where the 
result is at lower precision than the MAC registers. The 

25 Source_3 register is used as a third source register for 
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instructions that can use three source operands. One 
example of such an instruction is a double-shift instruction 
(SHFTD) that uses the Source_3 register to supply its right 
shift count. The Context_cnt register maintains a count of 
5 the executed instructions for the associated context. When 
the execution of a context is suspended, the associated 
count will also stop . 

The control and status (CSR) register is a 32 bit 

10 register that is described in greater detail below with 

respect to Figure 6b. The read only status register (ROSR) 
is a 32 bit register that is an extension of a control 
status register (CSR) , described below f that is set by 
hardware and is capable of being read by software, but not 

15 set by software. When bit 0 is set it indicates a pending 
interrupt condition for the thread associated with the 
context. When bit 1 is set it indicates that the FLASH 
memory is busy and that the thread has an uncompleted FLASH 
memory access operation in progress, e.g., a read, write or 

20 erase command. Bits 12-16 identify the current context. As 
described above, these bits indicate the context associated 
with the thread and will be the default context for all 
operands. The remaining bits may be used for other status 
indications. The interrupt mask registers are two 32 bit 

25 registers that can be combined to define a 64 bit mask which 
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can be used to determine when an interrupt is seen by the 
thread. The I READ register stores the output of an I READ 
instruction. The program counter (PC) is a 32 bit program 
counter. 

The control and status register (CSR) includes 
condition codes and other status bits as well as thread- 
specific control bits. The CSR can be read from and written 
to by both hardware and software. Figure 6B is an 
illustration of the CSR according to one embodiment of the 
present invention. Bits 3-0 of the CSR are the 16-bit 
operand condition code bits (OCCB) in the order {N,Z,V,C}i 6 . 
Bits 7-4 of the CSR are the 32-bit operand condition code 
bits (OCCB) in the order {N,Z,V,C} 3 2- Bits 13-8 correspond 
to the source operand context selection feature of the 
present invention. Bit 8 is an enable source override (ESO) 
bit which, when set, is used by the processor to select the 
source operand from the context identified in bits 13-9, 
i.e., the source thread selection bits (STS) . 

Bits 19-14 correspond to the destination operand 
selection feature of the present invention. Bit 14 is an 
enable destination override (EDO) bit which, when set, is 
used by the processor to select the context to which the 
destination operand will write any result from the context 
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identified in bits 19-13, i.e., the destination thread 
selection bits (DTS) . 

The present invention permits any thread to modify the 
5 context (and therefore the thread) from which the source 
operand reads and to which the destination operand writes. 
This feature permits one thread to be a supervisory thread 
that can control other threads by, for example, initializing 
threads and starting new tasks. It also permits the 

10 supervisory thread to multiplex several tasks onto a single 
hardware thread, by suspending that thread, reading its 
state and saving it, writing the state of the new task, and 
resuming the thread. It also permits a debugger kernel 
running in one thread to control and monitor another thread. 

15 The debug kernel can read and write the state of the thread 
being debugged and allow the user to control that state. 

As described above, in one embodiment of the present 
invention one thread of the multithreaded system is 

20 designated as a supervisory thread, which controls the other 
threads. When the supervisory thread wants to start another 
thread, it is able to write to that thread's state in order 
to initialize it. In some cases, several contexts will be 
time-multiplexed onto a single hardware thread. In this 

25 case, the present invention permits the supervisory thread 
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to read and save the current state of another hardware 
thread, and write the current state of the next context that 
needs to be executed. In some applications, these 
supervisory operations are frequent, so reading or writing 
5 another thread' s state must be efficient and simple as per 
the present invention. 

Another problem resolved by the present invention is 
that once the destination context is altered by modifying 
10 the destination thread selection bits (DTS) it is not 

possible for the present thread to switch it back, because 
the CSR register is part of the thread context. 

The present invention solves this problem by creating 
15 an instruction for writing a value to the CSR of the 

currently executing context. In one embodiment of the 
present invention the instruction is referred to as SETCSR 
and can be used to overwrite the CSR in the current context 
which enables it to modify the source (STS) and destination 
20 contexts (DTS) as well as the other bits in the CSR. 

As described above, the present invention operates in 
an instruction level multithreading system and method that 
takes advantage of the zero-time context switch to rapidly 
25 (as frequently as every instruction) switch between two or 
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more contexts. Some techniques for how threads are 
scheduled and how zero-time context switching occurs are 
described below. 



5 The amount of time that each context executes for is 

called a quantum. The smallest possible quanta is one clock 
cycle, which may correspond to one instruction. A quanta may 
also be less than one instruction for multi-cycle 
instructions (i.e., the time-slice resolution is determined 
10 solely by the quantum and not the instruction that a thread 
is executing) . A detailed description of the allocation and 
scheduling is described below and is described in U.S. 
Patent Application No. 09/748,098 that is incorporated by 
reference herein in its entirety. 

15 

The allocation of the available processing time among 
the available contexts is performed by a scheduling 
algorithm. In one embodiment of the present invention, a 
benefit occurs when the allocation of quanta is done 
20 according to a fixed schedule. This scheduling of the 

contexts can be broken into three classes strict scheduling, 
semi-flexible scheduling and loose scheduling. 



Figure 7a is an illustration of a strict scheduling 
25 example according to one embodiment of the present 
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invention. Figure 7b is an illustration of a semi-flexible 
scheduling example according to one embodiment of the 
present invention. Figure 7c is an illustration of a loose 
scheduling example according to one embodiment of the 
5 present invention. 

With reference to Figure 7a, when the scheduler, e.g., 
the thread controller that is illustrated in Figure 3, 
utilizes strict scheduling the schedule is fixed and does 

10 not change over short periods of time. For example if the 

schedule is programmed to be "ABAC" as illustrated in Figure 
7a then the runtime sequence of threads will ^ ABAC ABAC ABA C . . . " 
as illustrated in Figure 7a. Threads that are strictly 
scheduled are called hard-real-time (HRT) threads because 

15 the number of instructions executed per second is exact and 
so an HRT thread is capable of deterministic performance 
that can satisfy hard timing requirements. 

With reference to Figure 7b, when the scheduler 
20 utilizes a semi-flexible scheduling technique some of the 
schedule is fixed and the rest of the available quanta are 
filled with non-real time (NRT) threads. For example, if 
the schedule is programmed to be "A*B*" where is a 

wildcard and can run any NRT thread, the runtime sequence of 
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threads, with threads D, E and F being NRT threads, could be 
"ADBEAFBEAFBE..." as illustrated in Figure 7b. 

Some of the benefits of using either strict scheduling 
5 or semi-flexible scheduling is that the allocation of 

execution time for each HRT thread is set and therefore the 
time required to execute each thread is predictable. Such 
predictability is important for many threads since the 
thread may be required to complete execution within a 
10 specific time period. In contrast, the interrupt service 
routine described above with reference to conventional 
systems does not ensure that the hard real time threads will 
be completed in a predictable time period. 

15 The static and semi-flexible schedule for hard real- 

time threads is achieved using a programmable quantum cycle 
table. Each entry in the table represents an available 
quanta cycle and provides the hard-real-time thread the 
cycle it is allocated to. The table is of variable length, 

20 e.g., up to 64 entries. When the end of the table is 

reached the scheduler continues from the first element in 
the table thus providing an infinitely repeating sequence. 
For example, Figure 7d is an illustration of a semi-flexible 
thread schedule using three hard-read time threads according 

25 to one embodiment of the present invention. Thread A is 
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10 



scheduled 50% of the time, thread B is scheduled 25% of the 
time and thread C is scheduled 12.5% of the time. The 
remaining 12.5% is allocated to processing non-real time 
threads. If the CPU is clocked at 200 MIPS this would 
equate to thread A having a dedicated CPU execution rate of 
100 MIPS, thread B having a dedicated CPU execution rate of 
50 MIPS, thread C having a dedicated CPU execution rate of 
25 MIPS and the remaining threads, e.g., non-real time 
threads, having a minimum CPU execution rate of 25 MIPS. 



Accordingly, each hard-real time thread is guaranteed 
particular execution rate because they are allocated 
instruction slots as specified in the table, thus they each 
have guaranteed deterministic performance. The 

15 predictability afforded by the present invention 

significantly increases the efficiency of programs since the 
time required to execute hard-real time threads is known and 
the programs do not need to allocate extra time to ensure 
the completion of the thread. That is, the interrupt 

20 latency for each hard-real-time thread is deterministic 

within the resolution of its static allocation. The latency 
is determined by the pipeline length and the time until the 
thread is next scheduled. The added scheduling jitter can 
be considered to be the same as an asynchronous interrupt 

25 synchronizing with a synchronous clock. For example, a 
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thread with 25% allocation will have a deterministic 
interrupt latency with respect to a clock running at 25% of 
the system clock. 



5 Although the table reserves the instruction slots for 

the hard real-time tasks this does not mean that other non- 
real time tasks cannot also execute in that instruction 
slot. For example, thread C may be idle most of the time. 
For example, if thread C represents a 115.2 kbps UART, then 

10 it only needs deterministic performance when it is sending 
or receiving data. There is no need for it to be scheduled 
when it is not active. All empty instruction slots, and 
those instruction slots which are allocated to a thread that 
is not active can be used by the scheduler for non-real time 

15 threads. 



More than 50 percent of the available MIPS can be 
allocated to a single thread, although this will result in a 
non-deterministic inter-instruction delay— the time between 

20 successive instructions from the same thread would not be 
the same. For some applications this varying inter- 
instruction delay is not a disadvantage. For example a 
thread could be scheduled in slots 1, 2, 3, 5, 6, 7, 9, ... 
to achieve 75 percent of the available MIPS of the CPU. One 

25 type of NRT thread scheduling rotates through each thread. 
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That is, the threads are scheduled in order, with one 
instruction executed from each active thread- This type of 
semi-flexible scheduling permits non-real-time threads to be 
scheduled in the empty slots in the schedule, e.g., the 
5 quanta labeled w *" in Figure 7d, and in slots where the 
scheduled hard real-time thread is not active, e.g., in 
place of thread B if thread B is not active, as described 
above. This type of scheduling is sometimes referred to as 
^round robin" scheduling. 

10 

Multiple levels of priority are supported for non-real- 
time threads. A low priority thread will always give way to 
higher priority threads. The high level priority allows the 
implementation of an real time operating system (RTOS) in 

15 software by allowing multi-instruction atomic operations on 
low-priority threads. If the RTOS kernel NRT thread has a 
higher priority than the other NRT threads under its control 
then there is a guarantee that no low priority NRT threads 
will be scheduled while the high priority thread is active. 

20 Therefore the RTOS kernel can perform operations without 

concern that it might be interrupted by another NRT thread. 

With reference to Figure 7c, when the scheduler 

utilizes a loose scheduling technique none of the quantum 
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are specifically reserved for real time threads and instead 
any quantum can be used for non-real time (NRT) threads. 

A thread can have a static schedule (i.e., it is 
5 allocated fixed slots in the HRT table) and also be flagged 
as an NRT thread. Therefore, the thread will be guaranteed 
a minimum execution rate as allocated by the HRT table but 
may execute faster by using other slots as an NRT thread. 

10 The present invention includes hardware support for 

running multiple software threads and automatically 
switching between threads and is described below. This 
multi-threading support includes a variety of -features 
including real time and non-real time task scheduling, 

15 inter-task communication with binary and counting semaphores 
(interrupts) , fast interrupt response and context switching, 
and incremental linking. 

By including the multi-threading support in the 
20 embedded processor core the overhead for a context switch 
can be reduced to zero. A zero-time context-switch allows 
context switching between individual instructions. Zero-time 
context-switching can be thought of as time-division 
multiplexing of the core. 
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In one embodiment of the present invention can fetch 
code from both SRAM and flash memory, even when the flash 
memory is divided into multiple independent blocks. This 
complicates the thread scheduling of the present invention. 
5 In the present invention, each memory block is scheduled 
independently of the overall scheduling of threads. Figure 
8 is an illustration of thread fetching logic with two 
levels of scheduling according to one embodiment of the 
present invention . 

10 

In one embodiment of the present invention the 
instructions that are fetched can be stored in multiple 
types of memory. For example, the instructions can be 
stored in SRAM and flash memory. As described above, 

15 accessing data, e.g., instructions, from SRAM is 

significantly faster than accessing the same data or 
instructions from flash memory. In this embodiment, it is 
preferable to have hard real time threads be fetched in a 
single cycle so all instructions for hard-real-time threads 

20 are stored in the SRAM. In contrast, fetching instructions 
from non-real-time threads can be stored in either SRAM or 
flash memory. 

With reference to Figure 8, instructions in shadow SRAM 
25 are fetched based upon a pointer from either an HRT thread 
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selector 802 or an NRT shadow thread selector 804. 
Instructions from the flash memory are fetched based upon a 
pointer from an NRT flash thread selector 806. The thread 
selectors 802, 804, 806 are described in greater detail 
5 below. The output of the SRAM and the flash memory are 
input into a multiplexor (MUX) 810 that outputs the 
appropriate instruction based upon an output from a post 
fetch selector 812, described below. The output of the MUX 
is then decoded and can continue execution using a 
10 traditional pipelined process or by using a modified 
pipelined process as described below, for example. 

Figure 9 is an illustration of the HRT thread selector 
802 according to one embodiment of the present invention. 

15 As indicated above, the shadow SRAM 820 provides a single 

cycle random access instruction fetch. Since hard real time 
(HRT) threads require single cycle determinism in this 
embodiment such HRT threads may execute only from SRAM. The 
HRT thread controller 802 includes a bank selector 902 that 

20 allows the choice of multiple HRT schedule tables. The back 
selector determines which table is in use at any particular 
time. The use of multiple tables permits the construction 
of a new schedule without affecting HRT threads that are 
already executing. . A counter 904 is used to point to the 

25 time slices in the registers in the HRT selector 802. The 
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counter will be reset to zero when either the last entry is 
reached or after time slice 63 is read. The counter 904 is 
used in conjunction with the bank selector 902 to identify 
the thread that will be fetched by the shadow SRAM in the 
5 following cycle. If the identified thread is active, e.g., 
not suspended then the program counter (PC) of the 
identified thread is obtained and is used as the address for 
the shadow SRAM in the following cycle. For example, with 
respect to Figure 9, if based upon the bank selector 902 and 

10 the counter 904 time slice number 1 is identified, the 

thread identified by this time slice represents the thread 
that will be fetched by the SRAM in the following cycle. The 
output of the block described in Figure 9 is a set of 
signals. Eight signals are used to determine which of the 

15 eight threads is to be fetched. Of course this invention is 
not limited to controlling only eight threads. More signals 
could be used to control more threads. One signal is used to 
indicate that no HRT thread is to be fetched. 

20 Figure 10 is an illustration of the NRT shadow SRAM 

thread selector 8 04 and shadow SRAM accessing logic 
according to one embodiment of the present invention. The 
NRT shadow thread selector 804 includes an available thread 
identifier 1010 a register 1012 for identifying the previous 

25 dynamic thread that has been fetched from the shadow SRAM 
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and a flip-flop (F/F) 1011. The register and available 
thread identifier 1010 (described below) are received by a 
thread selector unit that selects the thread to be accessed 
by the SRAM in the next cycle, if any. The thread selector 
5 1014 uses the last thread number from 1012 and the available 
thread identifier from 1010 to determine which thread to 
fetch next to ensure a fair round-robin selection of the NRT 
threads . 

10 Figure 11 is an illustration of the NRT available 

th read identifier 1010 accordincr to one embodiment of the 
present invention. The NRT available thread identifier 1010 
generates an output for each thread based upon whether the 
thread is active, whether the thread is identified as being 

15 dynamic (NRT) , and whether the thread is marked as being of 
a high priority. If there are no active, dynamic, high 
priority threads then the NRT available thread identifier 
1010 generates an output for each thread based upon whether 
the thread is active, whether the thread is identified as 

20 being dynamic (NRT), and whether the thread is marked as 
being of a low priority. 

The NRT shadow SRAM thread selector 804 generates for 
each thread a shadow-NRT-schedulable logic output based upon 
25 logic that determines whether the NRT schedulable output is 
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true and whether the thread PC points to shadow SRAM. The 
determination of whether the PC specifies a location in 
shadow SRAM is done by inspecting the address— the shadow 
SRAM and flash are mapped into different areas of the 
5 address space. 

As described above the NRT available thread identifier 
1010 identifies the available threads and one of these 
threads is selected based upon a previous thread that was 
10 selected and successfully fetched out of shadow RAM and used 
by the pipeline that is stored in register 1012. 

If the HRT thread selector 802 indicates that the cycle 
is available for an NRT thread, then the PC of the selected 
15 thread is obtained to be used as the address for the shadow 
SRAM access in the following cycle. 

The selected thread number (including if it is ^no- 
thread' ) is latched to be the register 1012 unless the 

20 current shadow SRAM access is an NRT thread (chosen in the 
previous cycle) AND the post-fetch selector 812 did not 
select the shadow SRAM to be the source for the decode 
stage. That is, the selected thread number is latched to be 
the "previous thread" register 1012 only if the current 

25 shadow SRAM access is a HRT thread OR if the current shadow 
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SRAM access is no-thread OR if the current SRAM access is an 
NRT thread that has been chosen by the post-fetch selector 
812. The post-fetch selector 812 is described in greater 
detail below. 

5 

Figure 12 is an illustration of the NRT flash memory 
thread selector 806 according to one embodiment of the 
present invention. The flash read only memory (ROM) 
requires multiple clock cycles to access its data. In this 

10 embodiment of the present invention, in order to increase 

the instruction rate from the flash ROM the flash is divided 
into four blocks corresponding to four ranges in the address 
space. These blocks are identified as flash A, flash B, 
flash C, and flash D in Figure 8. Each block can fetch 

15 independently and so each requires its own NRT thread 

selector 806 to determine which threads can be fetched from 
each particular block. As indicated above, only NRT threads 
can be executed from the flash ROM. 

20 The intersection of the set of active threads and the 

set of threads whe re the PC is in this flash block is 
generated by the available thread identifier 1010 and is 
received by a thread selector 1214. The thread selector 1214 
uses the previous thread number to select the next thread in 

25 a round-robin manner. The thread PCs unit 1214 determines 

-31- 

F&W Ref . 6029 
20880/06029/DOCS/l 176973.3 



the program counter (PC) for the selected thread and passes 
this PC to the flash block as the address. The output of 
the flash is double buffered, meaning that the output will 
stay valid even after a subsequent fetch operation begins. 

5 

Figure 13 is an illustration of the post fetch selector 
according to one embodiment of the present invention. After 
each of the flash blocks and SRAM block has selected a 
thread, the post fetch selector 812 chooses the thread that 

10 is passed to the pipeline. If a HRT thread is active this is 
always chosen. Otherwise an NRT thread will be chosen. In 
this example the flash/shadow SRAM resource is chosen in a 
round-robin order, depending on the last flash (or shadow 
SRAM) block that an NRT thread was selected from by the 

15 source selector 1302. 



Another aspect of the present invention is the ability 
to save and restore thread states for either the related 
thread or another thread. Multithreaded CPUs have several 

20 threads of execution interleaved on a set of functional 

units. The CPU state is replicated for each thread. Often 
one thread needs to be able to read or write the state of 
another thread. For example, a real-time operating system 
(RTOS) running in one thread might want to multiplex several 

25 software threads onto a single hardware thread, so it needs 
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to be able to save and restore the states of such software 
threads . 

Other processors have a separate operating system (OS) 
5 kernel running on each hardware thread, that is responsible 
for saving and restoring the state of that thread. This may 
not be adequate if code from an existing RTOS is to be used 
to control hardware threads . 

10 One type of instruction set that can be used with the 

present invention is a memory to memory instruction set, 
with one general source (memory or register) , one register 
source, and one general destination. The invention allows 
one thread to set its general source, general destination, 

15 or both, to use the thread state of another thread. Two 
fields in the processor status word, source thread, and 
destination thread, are used, and override the normal thread 
ID for the source and/or destination accesses to registers 
or memory. 

20 

This invention allows RTOS code from traditional 
single-threaded CPUs to be easily ported to the new 
multithreaded architecture. It gives a simple way state 
between a worker thread and a supervisory thread. 
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In another embodiment of the present invention, the 
above described multithreading system can be used with more 
powerful pipeline structures. Figure 14 is an illustration 
of a multithreaded issue switching pipeline according to one 
5 embodiment of the present invention. In conventional 

pipeline processing environments the fetch and decode stages 
result in the same output regardless of when the fetch and 
decode operations occur. In contrast the issue stage is 
data dependant, it obtains the data from the source 
10 registers, and therefore the result of this operation 

depends upon the data in the source registers at the time of 
the issue operation. In this embodiment of the present 
invention the thread-select decision is delayed to the input 
of the issue stage. 

15 

In one embodiment of the present invention, issue 
switching is implemented by using thread latches in the 
fetch and issue stages as shown in Figure 14. The issue 
stage decides which thread to execute based not only on 
20 priority, and the thread-switching algorithm (as with the 
pre-fetch selection) , but also on data and resource 
dependencies. Any number of threads could be managed in 
hardware by increasing the number of latches within the 
fetch and issue stages. 

25 
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Figure 15 is an illustration of a multithreaded 
parallel decode pipeline according to one embodiment of the 
present invention. Figure 15 shows the parallel fetch and 
decode enhancement. The parallel fetch stages need memory 
5 access during each every cycle and therefore cannot be 

paralleled without a pre-fetch system or by multi-porting 
the program memory. Multi-porting of program memory would 
not be an economical solution as every thread would require 
its own port with poor utilization. A pre-fetch system 

10 could be used to reduce bus contentions by fetching lines of 
program-memory at a time. If a buffer line was implemented 
for every thread and these buffer lines were multi-ported 
between the fetch and decode stages then the fetch unit 
could supply instructions from any threads in parallel. As 

15 a result, the thread-switch can better hide a pipeline flush 
and decrease the interrupt latency. For example, the jump 
flush improvement comes in the situation when there are 
insufficient equal priority threads to launch and a lower 
priority thread could be launched instead. The interrupt 

20 latency improvement would be due to the start of the ISR 

code being already fetched and decoded ready for issuing on 
interrupt . 



Figure 16 is an illustration of a multithreaded 
25 superscalar pipeline according to one embodiment of the 
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present invention. In Figure 16 multiple instructions are 
executed in parallel from the same thread or from different 
thread sin order to maximize the utilization of the execute 
functional units. The issue stage is responsible for the 
5 thread selection, resource allocation, and data dependency 
protection. Therefore, the issue stage is capable of 
optimizing the scheduling of threads to ensure maximum 
resource utilization and thus maximum total throughput. The 
earlier stages (Fetch and Decode) attempt to maintain the 
10 pool of threads available to the issue thread selector. 

One feature of the multithreading embedded processor of 
the present invention is the ability to integrate virtual 
peripherals (VPs) that have been written independently and 
15 are distributed in object form. Even if the VPs have very 
strict jitter tolerances they can be combined without 
consideration of the effects on the different VPs on each 
other . 

20 For example consider the VPs and tolerable jitter 

below: (1) UART 115.2 kbps, 217 nanoseconds (ns) , (2) 
lOBaseT Ethernet, 10 ns, (3) TCP/IP stack, 10 milliseconds 
(ms), and (4) application code, 50 ms. If a designer is 
integrating these VPs to make a system he or she merely 

25 needs to determine the static schedule table. 
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Since the TCP/IP and application code is timing 
insensitive both VPs are scheduled as NRT threads. The 
other two VPs need deterministic response to external events 
5 and so must be scheduled as hard real-time threads. If the 
target CPU speed is 200MHz then the Ethernet VP requires 50% 
of the MIPS, i.e., a response of 5ns, and it cannot have 
more than one instruction delay between its instructions. 
The UART VP requires less than 1% of the MIPS but does 
10 require to be serviced within its jitter tolerance so is 
scheduled four times in the table. 



The result is that four VPs, possibly each from 
different vendors, can each be integrated without modifying 
15 any code and requiring only some simple mathematics to 
determine the percentage of total computing power each 
thread needs. The VPs will work together without any timing 
problems since each thread that needs it is guaranteed its 
jitter performance. 

20 

Of course the VPs will only work together if they can 
communicate with each other. This requires the definition of 
suitable high-level APIs the details of which would be 
apparent to a person of ordinary skill in the art. 
25 Table 1 is an example of a receive UART thread. 
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UartRxReset 

: Start setb UartRxPinlntE /Enable hardware interrupt 

clrb UartRxPinlntF ; Clear hardware interrupt flag 

suspend ;Wait for start edge int 

mov RTCC, #Uartll5200 * 1.5 .-Initialise RTCC 

clrb RTCCIntF ; Clear timer interrupt flag 

setb RTCCIntE ; Enable timer interrupt 

mov UartRxBits, #%01111111111111111 /Reset data bits 



10 



15 



clrb 


UartRxPinlntE 


/Disable hardware interrupt 


clc 




/Guess input will be a 0 


suspend 




/Wait for timer interrupt 


snb 


UartRxPin 


/Is the input 1 ? 


stc 




/yes => change to a 1 


rr 


UartRxBits, 1 


/Add bit to data bits 


snb 


UartRxBits. 7 


/Complete ? 


jmp 


:Loop 


/No => get next bit 


clc 




/Will shift in 0 


rr 


UartRxBits, 8 


/Shift data bits right 8 times 


mov 


UartRxData, UartRxBits 


/Save data 


int 


UartRxAvaillnt 


/Signal RxAvail interrupt 


clrb 


RTCCIntE 


/Disable timer interrupt 


jmp 


: Start 


/Wait for next byte 



2|j Table 1 

J]J The thread suspends itself pending the falling edge of the 

start bit. When this interrupt occurs the thread is resumed and 
the timing for the incoming data is based on the exact time that 
30 the start edge was detected. This technique allows higher 

accuracy and therefore enables improves the operation of embedded 
processors . 



The thread will suspend itself pending the next timer 
35 interrupt for every bit that is received (The RTCC timer is 
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independent for each thread and so will not conflict with other 
VPs) . 



On the completion of the byte the code issues a software 
interrupt to signal to the application layer that a byte is 
available to be read. The "INT" instruction simply sets the 
interrupt flag. The application layer will either be polling this 
interrupt flag or will be suspended and so resumed by this 
interrupt . 

An example of a transmit UART thread is set forth in Table 

2. 

UartTxReset 





setb 


UartTxPin 


;Idle high 


Start 


clrb 


RTCCIntE 


; Disable timer interrupt 




setb 


UartTxStartlntE 


; Enable TxStartlnt 




suspend 




;Wait for TxStart int 




clrb 


UartTxPin 


; Output start bit 




mov 


RTCC, #Uartll5200 


; Initialise RTCC 




clrb 


RTCCIntF 


; Clear timer interrupt flag 




setb 


RTCCIntE 


; Enable timer interrupt 




mov 


UartTxBits, UartTxData 


;Save data to transmit 




setb 


UartTxBits.8 


;Add stop bit to data 




clrb 


UartTxStartlntE 


; Disable TxStart interrupt 




clrb 


UartTxStartlntF 


/Clear TxStart interrupt flag 




int 


UartTxEmpty 


; Indicate ready for next byte 


Loop 


clc 




;Will shift in 0 




rr 


UartTxBits, 1 


/Shift data by 1 




snc 




/Carry a 0? 




jmp 


:1 


/No => prepare to output 1 


0 


suspend 




/Yes => wait for timer int 




clrb 


UartTxPin 


/Output 0 




mov 


RTCC, #Uartll5200 


/Initialise RTCC 




test 


UartTxBits 


/Check bits 
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sz 

jmp :Loop 

jmp : Start 
: 1 suspend 

setb OartTxPin 

mov RTCC, #Uartll5200 

test UartTxBits 

sz 

jmp :Loop 

jmp : Start 



;More bits to send ? 

;Yes => prepare next bit 

;No => wait for next byte 

;Wait for timer int 

; Output 1 

/Initialise RTCC 

; Check bits 

;More bits to send ? 

;Yes => prepare next bit 

;No => wait for next byte 



Table 2 



The thread suspends itself pending the user-defined TxStart 
software interrupt. When this interrupt is triggered by the 
application thread the Tx UART thread is resumed and the byte to 
be transmitted is transferred into an internal register 
(UartTxBits) . At this point in time the application is free to 
send a second byte and so the interrupt flag is cleared and the 
UartTxEmpty interrupt is triggered. 

The byte is transmitted by suspending after each bit - 
pending the next RTCC interrupt (The RTCC timer is independent 
for each thread and so will not conflict with other VPs) . 

When the transmission is complete the thread will suspend 

pending the TxStart interrupt again. It is possible that the 

TxStart interrupt was triggered during the transmission of the 

last byte and so the thread may be resumed immediately. 
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While the invention has been particularly shown and 
described with reference to a preferred embodiment and several 
alternate embodiments, it will be understood by persons skilled 
in the relevant art that various changes in form and details can 
be made therein without departing from the spirit and scope of 
the invention. 
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